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GENERALIZED  LIST  DETECTION  FOR  CODED  MFSK/FH  SIGNALING  ON 
FADING  AND  JAMMING  CHANNELS 


INTRODUCTION 

Modern  digital  communication  systems  are  frequently  required  to  operate  in  severe  interference 
environments.  These  disturbances  include  a  variety  of  fading  and  jamming  phenomena  arising  from 
natural  and  man-made  sources.  Usually,  when  the  interference  type  is  well  understood,  adequate  per¬ 
formance  can  be  achieved  by  using  the  right  combination  of  modulation,  error  control  coding,  and 
spread  spectrum  techniques.  This  was  demonstrated  in  1975  by  Viterbi  and  Jacobs  111,  who  showed 
that  coding  can  lead  to  considerable  improvement  in  the  performance  of  multiple  frequency  shift  keying 
(MFSK)  frequency  hopped  (FH)  systems  on  Rayleigh  fading  and  worst-case  partial  band  Gaussian 
interference  channels. 

In  the  presence  of  intelligent  jamming  there  are  special  difficulties  which  must  be  addressed.  Of 
particular  concern  is  the  fact  that  pure  soft-decision  decoding*  does  not  work  effectively  in  an  intelli¬ 
gent  jamming  environment  unless  the  communication  receiver  has  side-information  concerning  the 
state  of  the  jamming  signal  [2,3J.  This  is  true  because  a  pure  soft-decision  receiver  without  side- 
information  is  vulnerable  to  a  jamming  strategy  where  high  jamming  power  can  be  concentrated  on  a 
single  element  of  a  coded  transmission  sequence  and  lead  to  a  large  number  of  decoding  errors. 
Whereas  pure  soft-decision  decoding  usually  outperforms  hard-decision  decoding  in  nonintelligent 
interference  environments,  the  opposite  is  true  against  intelligent  jamming  when  the  receiver  does  not 
possess  jamming  state  information. 

One  approach  to  alleviating  the  problem  of  soft-decision  decoding  in  the  absence  of  side- 
information  is  to  quantize  the  demodulator  outputs  with  a  finite  number  of  threshold  levels.  The 
difficulty  with  threshold  quantization  detection  is  that  optimum  threshold  setting  requires  perfect 
automatic  gain  control  (AGC),  which  is  difficult  to  maintain  in  jamming  or  fading. 

An  alternative  approach  called  list-metric  detection  is  presented  in  this  report.  With  this  tech¬ 
nique,  demodulator  outputs  are  ranked  in  magnitude  from  the  highest  to  the  lowest,  and  decoder 
metrics  are  assigned  to  these  outputs  according  to  their  position  in  the  ranking  rather  than  their  magni¬ 
tude.  The  process  of  rank-ordering  is  equivalent  to  partitioning  the  A/-dimensional  observation  space  of 
the  M  demodulator  outputs  into  several  regions  corresponding  to  the  different  ordered  lists.  In  this 
sense,  listing  is  another  form  of  soft-decision  quantization  because  it  creates  a  discrete  memoryless 
channel  (DMC)  with  more  outputs  than  inputs  as  seen  by  the  encoder/decoder.  Note  that  this  form  of 
quantization  does  not  depend  upon  thresholds  which  are  difficult  to  maintain  during  jamming.* 

Previous  work  [5-7)  has  considered  list-of-£  detection,  which  is  a  special  case  of  list-metric  detec¬ 
tion.  It  has  been  shown  [5,61  that  list-of-L  detection  with  optimum  metrics  is  inferior  to  threshold 
quantization  detection  for  additive  white  Gaussian  (AWGN)  channels.  The  results  of  these  previous 
list-detection  studies  are  generalized  in  this  report  by  introducing  greater  flexibility  in  the  choice  of 
metrics.  Also,  analysis  of  the  optimum  metric  results  is  extended  to  include  fading  and  jamming  chan¬ 
nels. 

Manuscript  approved  March  2,  1983. 

•Pure  soft-decision  decoding  refers  to  the  situation  where  the  actual  analog  demodulator  outputs  are  provided  to  the  decoder 
The  assumption  that  the  receiver  has  jamming  state  side-information  is  made  in  [1]. 

Viterbi  14J  has  proposed  a  related  approach  using  a  simple-to-implement  ratio-threshold  technique.  This  has  been  shown  to  be 
particularly  effective  against  tone  jamming. 
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The  second  section  of  this  report  is  devoted  to  a  background  discussion  of  the  methodology  for 
evaluation  of  communication  system  performance  with  an  arbitrary  choice  of  metrics.  A  general 
expression  of  the  performance  figure  of  merit,  the  cutoff  rate  parameter  R0,  is  derived  for  list-metric 
detection  in  the  third  section  of  this  report.  In  the  fourth  sectio,  the  optimal  metric  choice  for  list- 
metric  detection  is  presented.  Performance  is  evaluated  in  the  fifth  and  sixth  sections  of  this  report  for 
two  severe  communication  channels,  a  highly  idealized  worst-case  tone  jamming  channel  and  the  Ray¬ 
leigh  fading  channel.  Conclusions  are  drawn  and  a  recommendation  is  made  for  future  investigation  in 
the  last  section. 

METHODOLOGY  FOR  ANALYZING  PERFORMANCE 
OF  CODED  COMMUNICATION  SYSTEMS 

In  this  section  we  present  a  methodology  [2]  for  analyzing  a  general  communication  system  such 
as  that  shown  in  Fig.  1 .  Included  in  this  system  are  a  channel  encoder,  signal  modulator,  and  frequency 
hopper,  along  with  their  inverse  operations.  Also  shown  is  a  processor  which  acts  as  an  interface 
between  the  demodulator  and  decoder. 


COOING  CHANNEL 

( - 


n 


i _ i 


Fig.  I  —  A  general  communication  system 


The  ultimate  quantity  of  interest  is  the  probability  of  bit  error,  and  to  derive  a  bound  on  this 
quantity,  it  is  useful  to  decouple  the  coding  aspects  of  the  communication  system  from  the  remaining 
parts.  The  coding  channel,  that  is,  all  but  the  channel  encoder/decoder,  can  be  characterized  by  the 
cutoff  rate  parameter  R0  which  represents  the  practically  achievable  data  rate  (81.  For  any  specific  code 
and  for  most  modulations  of  interest,  it  is  possible  to  bound  the  decoded  bit  error  probability  by  a  func¬ 
tion  purely  of  R0\  that  is, 

Pb  B{R0).  (1) 
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The  cutoff  rate  parameter  R0  depends  solely  on  EJN0,  the  ratio  of  channel  bit  energy  to  one-sided 
noise  power  spectral  density,  that  is,  we  may  write 


*o- 


(2) 


Furthermore,  we  have 


£c_ 

N0  No' 


(3) 


where  Eb  is  the  energy  per  information  bit  and  R  is  the  code  rate  (channel  bits  per  information  bit). 
Thus,  from  Eqs.  (1-3),  Pb  can  be  bounded  by  a  function  of  EJNq,  for  the  coded  system. 

Since  the  function  B(R0)  is  unique  for  each  code,  and  the  parameter  R0  is  independent  of  the 
code,  it  is  possible  to  decouple  the  coder/decoder  from  the  coding  channel.  Various  modulation  sys¬ 
tems  can  be  compared  by  using  the  cutoff  rate  parameter  R0  and  specific  codes  can  be  evaluated 
separately. 

The  coding  channel  is  shown  in  Fig.  2.  For  convenience  it  is  separated  into  two  parts:  a  memory- 
less*  channel  which  includes  all  of  the  modulation/ demodulation  functions  and  a  processor  which  pro¬ 
vides  metrics  to  the  decoder.  For  the  memoryless  channel,  a  modulator  input  x  is  transformed  into  a 
demodulator  output  y  according  to  a  forward  conditional  probability  density  function  pCvIx).  (For 
MFSK  the  output  y  is  actually  an  A/-dimensional  vector  y  whose  components  are  the  M  matched  filter 
outputs  y\9  y2*  . ,  y^.  The  vector  notation  is  deleted  here  to  avoid  confusion  with  output  sequence 
vectors.)  For  each  demodulator  output  y ,  the  processor  generates  a  set  of  M  metrics  m(y,  x),  one  for 
each  of  the  input  hypotheses  x  Throughout  this  report  we  assume  that  decisions  are  made  according  to 
the  highest  metric. 


Fig.  2  —  Coding  channel 


Consider  two  input  sequences  (vectors)  of  length  jV,  x  and  x',  and  the  pairwise  error  probability 
of  the  receiver  choosing  x'  when  x  is  transmitted  assuming  that  these  are  the  only  two  possible 
transmitted  sequences.  This  probability  is  denoted  by  Pr{x  — >  x'}.  Using  the  Chernoff  bound  18]  with 
free  parameter  X  >  0,  we  obtain 


Pr{x 


*')  -  Pr  (  £  miyn,  x„)  <  T  m(yH,  x„')|x  1 

n-1  ) 

[mOv  x„')  -  m(y„,  x„)l  £  0|x 


JV 


<  E{e 


k  J 

*-1 


lx}, 


(4) 


where  £  is  the  expectation  operator,  and  the  subscript  n  refers  to  position  in  the  sequence. 


•The  memoryless  property  car.  be  achieved  either  by  interleaving  or  by  Frequency  hopping.  Successive  channel  inputs  are  treated 
in  a  statistically  independent  manner. 
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Since  the  channel  is  memory  less,  we  write  Eq.  (4)  as 


Defining 


we  see  that  Eq.  (5)  becomes 


PrU-x'U  n 

«— 1 


£>(x,  x';  X)  - 


Pr{x  —  x'}  <  fl  D(x„,  x„';  X). 


(5) 

(6) 

(7) 


The  cutoff  parameter  R0  is  defined  [9]  by 

R0  -  max  max  R0[p()\  Xl,  (8) 

A^O  p( ■) 

where  p(  )  is  the  input  probability  density  function  and  Rq[p(‘)\  Al  is  derived  from  the  relationship 
2-/t0l„<  >xl  -  E{D(x,  x’;  X)} 


-  £  £  p(x)p(x')ZMx,  x';  X). 

X  X * 


(9) 


For  orthogonal  MFSK  signaling  the  coding  channel  is  symmetrical  and  the  maximization  over  p( •) 
occurs  with  equally  likely  input  signals,  i.e.,  />(•)  —  1/Af  for  all  M  inputs.  Furthermore,  because  of  the 
symmetry  of  the  orthogonal  MFSK  signal  set,  we  recognize  that 


D(x,  x';  A) 


1  ,  x  —  x\ 

D(k)  ,  x  x'. 


(10) 


With  this  simplification  we  may  write  the  right-hand  side  of  Eq.  (9)  as 


£  X  p(x)p(x')D(x,  x';  A)  - 


1-MM-  1)Z)(A) 
M 


(ID 


and  the  cutoff  rate  parameter  becomes 

Ro  -  log2  M  -  log2  ll  +  (A/  -  DD),  (12) 

where 

D  —  min  D(A).  (13) 

AJ>0 

In  Eq.  (12)  we  see  that  for  orthogonal  signaling  there  is  a  simple  one-to-one  correspondence  between  D 
and  /lo¬ 
in  the  next  section  we  shall  use  these  results  to  evaluate  R0  for  the  list-metric  coding  channel. 

LIST-METRIC  DETECTION  AND  ITS  R0  EXPRESSION 

Consider  a  coded  MFSK/FH  receiver  as  shown  in  Fig.  3.  The  demodulator  consists  of  a  bank  of 
A/-matched  filter-envelope  detectors  whose  outputs  are  y\t  y2,  . . . ,  >v*  These  M  numbers  are 
presented  to  a  nonlinear  processor  which  produces  a  metric  vector  N  —  [N\9  N2,  . . . , 

A  list  metric  is  obtained  by  ranking  the  matched-filter  outputs  and  by  giving  the  /th  largest  output 
a  metric  value  N{.  The  list  metric  can  be  written  as  m(y,  x)  -  A^. 
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Fig.  3  —  General  receiver  configuration 


From  Eqs.  (6)  and  (10)  we  may  write 


It  follows  that 


,  XlW.  -AT, 

£>(A)  -  E[e  *  *  lx} 

M  k\N.  -N.  1,  ,  , 

-££{e  *  'k  /,- fc}Pr{/x- fc|x) 

*-i 
M 

“  I 

k-t 


M 


i—  £  exl/v'-/v*1  Prl/jj  —  fc|x}. 

1  (-1 

i*k 


D  -  min  — — r  £  £  e  '  ‘  -  1 
x>o  M  -  1  ktt 


9*. 


(14) 


(15) 


where  qk  »  /V|/x  -  *|x)  is  the  probability  that  the  sent  signal  appears  in  *,h  position  on  the  ordered 
list. 


The  channel  is  usually  characterized  by  the  forward  conditional  probability  density  functions  Po(a) 
and  Pi  (a)  for  each  matched-filter  output  a ,  where  pi(a)  is  the  output  density  when  the  input  is  signal 
plus  noise,  and  po(a)  is  the  output  density  when  the  input  is  noise  only.  Then,  for  A/-ary  orthogonal 
signaling  the  position  probabilities  qk  are  given  by 

~  (^fr/) /„  [/0%o(«)<f<*]  [1-J*o  ^o(«)^«j  PiWdfi,  (16) 


which  satisfy  the  conditions 


qk>  0,  k  -  1.  2 . M 


and 

u 

£  4*  “  * 

k-l 


Thus  the  vector  q  —  [q t,  qlt  ....  pM]  is  an  equivalent  characterization  of  the  channel. 
In  Eq.  (15),  we  may  define  the  array  sum  S(A,  N)  by 

S(k,  N))  -  £  £  qkekWrN*\ 

k-i  i-i 

The  minimum  of  this  expression  with  respect  to  X  >  Owe  designate  by  S,  that  is, 

S  —  min  S(A,  N). 


(17) 


(18) 
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From  this  it  follows  that 


D  - 


1 


A/-  1 

Then  from  Eq.  (12)  we  see  that 

*0  “  k>82  M  -  !og2  S 


-  log2  M  -  iog2 


[-1  +  SI. 


M  M 


mi"  I  I  ^ 

k*°  k- 1  rf-l 


k(NrNk) 


(19) 


(20) 


This  is  the  general  expression  for  R0  for  list-metric  detection,  and  it  is  applicable  for  any  choice  of  list- 
metric  vector  N.  In  the  next  section  we  derive  an  expression  for  the  particular  vector  N  which  maxim¬ 
izes  Rq  for  list-metric  detection. 


OPTIMAL  CHOICE  OF  N  FOR  LIST  METRIC  DETECTION 


The  choice  of  metric  vector  N  which  maximizes  Rq  in  Eq.  (20)  can  be  found  by  minimizing  the 
right  hand  side  of  Eq.  (17)  with  respect  to  X  and  N  [10].  That  is,  we  determine  the  quantity 


S  -  min  min  S(kt  N). 

k>  0  N 

To  perform  this  minimization  we  first  differentiate  S(A,  N)  with  respect  to  X  and  equate  to  zero, 

M  M 


N)  -  £  M  -  0. 


(21) 


(22) 


This  double  summation  has  all  zeros  on  the  diagonal  and  the  remaining  portion  can  be  written  in  two 
parts,  one  for  each  side  of  the  diagonal. 


-~^-N)  -  ft W,  -  Nk)ekWr"*' 


From  the  symmetry  of  the  terms  in  Eq.  (23),  we  may  write 

dS(A,  N)  * 
dA 


iL  *^|  ...  ....  k(N,—Nk)  AW.-WJ,  n 

2^  5J  W/- 1  k  -  Q,e  '  *1-0. 


(23) 


(24) 


Next,  we  minimize  S(\,  N)  with  respect  to  N.  This  is  accomplished  by  differentiating  with  respect  to 
Nj  for  >  —  1,  2,  . , . ,  M  and  equating  all  derivatives  to  zero. 


or 


s%r  -  A  [I  *i 1  + A  [I  *e'i  I -  “• 

aS(A'rN)  -  A  qkex(N''Nk) -xf  qJe~K(NrN')  -  0.  >-1,2 . M. 


(25) 


(26) 


In  Eq.  (26)  the  summations  are  carried  out  independently  so  we  may  arbitrarily  replace  the  index  /  by  k 
in  the  second  sum. 


-  *  Xj  q*ex(W  -  x  £  qjt -  0,  >-1,2 . M. 


bN, 


(27) 
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Also,  in  Eq.  (27),  we  may  use  the  subscript  i  in  place  of  j. 

_  x  £  I qkeKlNrNk)  -  q,e~k(*rNk)]  -  0.  /  -  I,  2 . M. 


dN, 


(28) 


In  Eqs.  (24)  and  (28),  we  have  the  identical  expression  in  brackets.  Thus  for  K  and  jV  to  maxim¬ 
ize  Rq ,  it  is  sufficient  that 


k(Ni  -  Nk)  -  In  —  /  —  for  all  pairs  1  <  /,  k,  <  A/. 
Qk 


A  particular  solution  of  Eq.  (29)  gives  the  optimal  choice 


X-i 


and 


N,-  In 

The  results  of  Eq.  (29)  may  be  used  in  the  optimal  Rq  expression 


Ro  ”  logj  M  -  log2 


.  £L  £L  kat.-ao 
min  min  £  £  qke  1  *  I 
x>0  N  ff[ 


to  yield 


R0  -  log2  M  -  log2 

-  log2  M  -  log2 


MM 

L  £ 

*-i  i—i 


(29) 


(30) 


(31) 


(32) 


M 


log2  M  -  2  log2  £  V«/- 

i-i 


(33) 


In  some  circumstances  it  is  desirable  to  use  a  list  of  demodulator  outputs  which  has  been  shor¬ 
tened  to  a  length  L  (for  L  <  Af).  In  doing  so,  the  lowest  M-L  outputs  are  treated  indistinguishably  as 
a  single  off-list  group.  This  can  be  accounted  for  by  using  a  position  probability  vector 

9-  (<7w  <72*  •••  .  Ql>  Qo>  Qo . <7ol  (34) 


where 


Qo  ~ 


M 

I  9i 

i-t+l 

M-L 


It  follows  from  Eq.  (31)  that  the  list-metric  vector  becomes 


N«  [ln<71(  in?2, - In qL,  ln^0 . In 


(35) 


•The  logar*^'  s  ust*i  n  this  metric  may  be  taken  to  any  base  and  have  an  arbitrary  common  bias  as  in  the  case  of  the  Fano 
metric  used  m  sequential  decoding  (91. 
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The  optimal  R0  corresponding  to  Eq.  (33)  for  the  shortened  list-of-L  is  seen  to  be 
*o  ~  lo&2  M  —  2  log2 


L  M 

L  +  L  «o 
(-1  <-£  +  1 


log2  M  -  2  logj 


I  +  ^J7IT~L)  £  Qi 


||-I  v  /-/.+ 1 

This  result  is  the  same  as  that  for  list-of-L  detection  as  presented  in  (5-71. 


(36) 


To  obtain  the  optimal  R0  of  Eq.  (36)  for  list-of-L  detection,  the  list-metric  vector  N  given  by  Eq. 
(35)  must  be  provided  to  the  decoder.  This  metric  information  is  based  upon  perfect  knowledge  of  the 
channel  statistics  (that  is,  perfect  knowledge  of  the  first  L  components  of  q).  Consequently,  the  degree 
to  which  the  optimal  list-metric  detection  performance  can  be  realized  depends  upon  how  well  these 
channel  parameters  can  be  measured  or  estimated  by  the  receiver.  In  the  next  two  sections  of  this 
report,  we  assume  that  this  perfect  channel  knowledge  is  available  in  determining  the  optimal  R0  for 
both  tone  jamming  and  Rayleigh  fading  channels. 


PARTIAL  BAND  TONE-JAMMING  CHANNELS 

The  performance  of  uncoded  orthogonal  MFSK/FH  signaling  against  worst-case  partial  band  tone 
jamming  was  found  by  Houston  (111.  In  this  section  we  consider  the  performance  of  list-metric  detec¬ 
tion  on  this  tone-jamming  channel. 

The  MFSK/FH  signaling  format  is  shown  in  Fig.  4.  A  total  hopping  bandwidth  W  is  divided  into 
b  subbands  with  each  tone  symbol  being  transmitted  on  a  different  frequency  hop.  Within  a  hopping 
subband,  one  of  M  tones  carrying  k  =*  log2  M  bits  is  sent  with  signal  power  S.  Candidate  tones  are 

orthogonally  spaced  with  a  frequency  spacing  A  -  ~  -  Rs  where  7;  is  the  symbol  duration  and  Rs  is 

As 

the  symbol  rate. 


HOPPING  SUBBAND 
WITH  M  CANDIDATE  TONES 


Fig.  4  —  MFSK/FH  signaling  format 


In  the  worst-case  jamming  strategy,  the  jammer  places  tones  in  as  many  hopping  subbands  as  pos¬ 
sible,  with  a  maximum  of  one  tone  per  subband.  The  jamming  tone  power  is  taken  to  slightly  exceed 
the  signal  power,  but  for  purposes  of  analytical  convenience  they  are  taken  to  be  equal.  In  this  tone 
jamming  strategy,  it  is  assumed  (perhaps  unrealistically)  that  the  jammer  has  perfect  knowledge  of  the 
communicator's  signal  power  lev  <  and  frequency  slots. 
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For  a  total  jamming  power  J%  the  jammer  will  attempt  to  force  incorrect  symbol  decisions  in  n  sub¬ 
bands  by  placing  in  them  tunes  with  power  J/n  —  S.  A  jamming  tone  will  successfully  cause  a  symbol 
error  if  it  hits  one  of  the  M  -  1  nontransmitted  tone  slots  in  the  transmission  subband  Thus,  the  pro¬ 
bability  of  symbol  error  is 


p  _  jl  M  -  1 
1  =  b  M 


(37) 


where  n/b  <  1  is  the  fraction  of  the  subbands  which  are  jammed.  For  orthogonal  signals,  it  follows 
that  the  probability  of  bit  error  is 


p  _  Mil  p  i  ^  SL  <  i 

P»  -  M-  \  Pi  2  b'  b^] 


Since  the  number  of  the  subbands  jammed  is 


and  the  total  number  of  subbands  is 


n  -  n  <  b. 


W 


MR,  9 


(38) 


(39) 


(40) 


where  MR,  is  the  bandwidth  of  one  subband,  it  follows  that  Eq.  (38)  may  be  written  as 

SW 


Ph  = 


1  1  Mgs 

2  S  W 

1 

2 


JR, 
SW 
JR c 


>  M 
^  M. 


(41) 


However,  since  S/R,  is  the  symbol  energy  and  JjW  is  the  equivalent  noise  power  spectral  density 
(W/Hz)  we  may  write 


Ph  = 


1  M 


2  E,/N  o 

X 

2 


JL 

No 


>  M 


E, 

IT  ^ 


(42) 


or 


P>- 


X  M_  _ 1_ 

2  k  Eh/N0 

x 

2 


A  "  M 

-V0  "  A 

r-o  < 


/V  o  ^ 

Furthermore,  the  optimal  jamming  fraction  may  be  determined  as 

M  1 


4  _ 


=  2/>„  = 


*  VV0 

1 


£/.  M 
N0  "  k 

II  ^  M 
n0<  r 


(43) 


(44) 


Over  the  usual  range  of  interest  (Eb/N0  ^  M//c),  the  dependence  of  on  £„/(V0  is  inverse  linear, 
with  the  probability  of  bit  error  increasing  by  a  factor  Ml log2  M  as  M  increases. 
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With  this  background,  we  now  consider  the  performance  of  a  coded  MFSK/FH  system  with  list- 
metric  detection.  For  the  worst-case  tone-jamming  channel  with  a  maximum  of  one  jamming  tone  per 
subband,  the  position  probability  vector  q  may  be  written  as 


q  *(<?),  V:.  0 . 0] 

where  q2  is  the  probability  of  symbol  error,  given  by 


<72  = 


M  -  1 


EJHq 

M  -  1 


M 


Es 

£s 


and  q{  is  the  probability  of  correct  symbol  decision  (1  -  q2)  given  by 


Q  i 


A/ - 

Es 


_1_ 

M 


M 


Es_ 

N0 


>  M. 


(45) 


(46) 


(47) 


The  optimal  list-metric  for  this  channel  is  N  =  lnq. 

From  Eq.  (36),  the  cutoff  rate  parameter  for  lisl-of-2  detection  on  a  worst-case  tone-jamming 
channel  is 

Ro  ~  log2  M  -  2  log2  lyfq[  +  -v/qj].  (48) 

The  list-of -2  curves  for  R0  vs  Es/N0  are  plotted  in  Fig.  5.  These  curves  exhibit  an  unusual  behavior. 
For  large  E,/N0,  R0  approaches  log2  M.  As  EJN0  decreases,  R0  decreases  to  a  minimum  value  of 
log2  M  -  1  when  qx  =  q2  =  1/2.  (In  a  sense,  the  missing  bit  per  channel  use  corresponds  to  the  total 
uncertainty  which  exists  as  to  whether  the  sent  signal  appears  first  or  second  in  the  ranking.)  The  con¬ 
dition  qt  =  q2  =  1/2  occurs  when  of  the  subbands  contain  a  jamming  tone.  In  each  subband 

which  has  a  jamming  tone,  there  is  probability  (M-U/M  that  the  jamming  tone  will  hit  a  slot  otheT  than 
that  occupied  by  the  sent  signal,  thereby  causing  a  symbol  error. 

As  £S/(V0  further  decreases,  Rq  increases  because  q2  >  Q\  and  the  metrics  In  qx  and  In  q2  become 
reverse  weighted.  That  is,  the  second  ranked  output  will  receive  a  higher  metric  than  the  first  if  there 
is  a  higher  probability  that  the  sent  signal  will  appear  second  on  the  list.  The  improvement  in  R0  con¬ 
tinues  as  q-Jq\  increases  until  the  full  band  is  jammed  with  one  tone  per  subband.  When  this  occurs 
the  ranking  probabilities  are 


1 

*■-7# 

(49) 

and 

M  -  1 

M  • 

(50) 

The  limiting  cutoff  rate 

parameter  becomes 

M  ... 

R°  ,  ,  2VM-  1" 

(51) 

for  all  values  of  £S/N0  <  Af.  Here,  the  jamming  cannot  be  made  more  effective  (as  long  as  there  is 
only  one  jamming  tone  per  subband)  because  there  is  always  a  probability  MM  that  the  jamming  tone 
will  coincide  with  the  sent  signal. 
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Fig.  5  —  R0  vs  EJS0  for  optimal  tone-jamming  channel 


Figure  6  shows  the  list-of-l  (hard-decision)  results  for  M  =  2,  4,  ...  ,  32.  These  were  deter¬ 
mined  from  the  R0  expression  of  Eq.  (46)  with  L  —  1, 

Ro  -  log2  M  -  2  log2  l^fq]  +  y/(M  ^\)q2]  (52) 


For  comparison,  the  list-of-l  and  the  list-of-2  results  are  plotted  together  for  M  =  2,  4,  . . .  ,  32 
in  Figs.  7  through  1 1.  These  show  the  improvement  of  list-of-2  detection  over  hard-decision  detection. 
The  poor  performance  of  hard-decision  detection  at  low  signal-to-noise  ratios  is  due  to  the  fact  that  the 
hard-decision  metric  vector 


N 


ln<?|,  In 


42 

M  -  1 


.  In 


4  2 

m  -  r  ” 


.  ,  In 


4  2 

M  -  1 


(53) 


does  not  contain  information  that  the  sent  signal  has  high  probability  of  appearing  second  on  the  list  of 
demodulator  outputs. 


In  a  companion  set  of  curves  Eb/N0  vs  code  rate  R  is  plotted  in  Figs.  12  through  18.  Here  the 
code  rate  is  taken  to  be  equal  to  the  cutoff  rate  parameter  (normalized  to  channel  bits  instead  of  chan¬ 
nel  symbols).  Since  there  are  log2  M  channel  bits-per-channel  symbol,  the  code  rate  at  cutoff  is  defined 
as 


and  it  follows  that 


log2A/’ 

Et  1  Es_  J_ 

N0~  R  log2  M  N0  “  o  W0 


(54 1 
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Fig.  10  —  R0  vs  EJN o  for  optimal 
tone-jamming  channel 


Fb/No  <dfi> 
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Fig  U  —  EfJ  S0  vs  code  rate  at  R  -  Rq/ log2A/ 
for  optimal  tone-jamming  channel 


Fig  15  —  EJ  -Vfl  vs  code  rate  at  R  - 

for  optimal  tone-jamming  channel 
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Fig  IS  —  £*/ Af0  vs  code  rate  at  R  •  /tylogjM 
for  optimal  tone-jamming  channel 


The  I  —  1  (hard  decision)  curves  in  Fig.  13  exhibit  the  usual  concave  characteristic  for  non¬ 
coherent  systems,  with  the  minimum  Eb/N0  occurring  at  low  code  rates.  At  very  low  code  rates,  Eb/N0 
increases  due  to  combining  losses  which  occur  in  coded  noncoherent  systems.  In  Figs.  14  through  18, 
we  again  see  the  improvement  of  list-of-2  detection  over  hard  decision  detection. 

Note  that  the  channel  model  assumed  here  is  idealized  and  somewhat  unrealistic  because  the  jam¬ 
mer  is  constrained  to  a  maximum  of  one  jamming  tone  per  subband.  Clearly,  if  more  jamming  tones 
are  used,  the  performance  of  Iist-of-2  detection  would  deteriorate  and  a  higher  list-of-L  detection 
scheme  would  be  required.  The  purpose  of  the  present  study  is  merely  to  show  the  potential  improve¬ 
ment  available  from  using  list-metric  detection  in  a  jamming  environment.  More  complicated  jamming 
models  and  larger  list  sizes  are  considered  in  a  separate  study  on  list  metric  detection  1 10]. 

RAYLEIGH  FADING  CHANNELS 


In  this  section  we  consider  the  performance  of  coded  MFSK  signaling  with  list  metric  detection  on 
a  Rayleigh  fading  channel.  For  this  channel  the  received  signal  is 


r(/)  -  n 


cos  (2rr/f  +  0)  +  n(t), 


where  n(f)  is  an  AWGN  process  with  two-sided  power  spectral  density  0  is  a  uniformly  distri¬ 
buted  random  phase  variable,  and  r  is  a  Rayleigh  amplitude  random  variable  with  normalized  probabil¬ 
ity  density  function 
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p(r)  -  2re  r  ,  r  >  0.  (57) 

With  this  normalization,  r2Es  is  the  received  energy  random  variable  with  average  value  Es  -  £s.  The 
amplitude  and  phase  random  variables  are  assumed  to  be  constant  over  the  duration  of  the  symbol,  but 
independent  from  one  symbol  to  the  next  because  of  the  memoryless  property  of  the  channel. 

The  optimal  (maximum  likelihood)  receiver  for  M  ary  orthogonal  signals  on  a  noncoherent  Ray¬ 
leigh  fading  channel  consists  of  a  bank  of  M  envelope  detectors,  one  matched  to  each  possible  signal. 
The  outputs  of  these  envelope  detectors  are  M  independent  Rayleigh  random  variables  [9].  For  the 
M  -  1  envelope  detectors  with  no  signal  present  (noise  only)  the  output  density  is 

_  a* 

/>*(«)-- %-e  N\  a>0,  (58) 

N0 

and  for  the  envelope  detector  with  signal  plus  noise  present  the  output  density  is 


Ps+N 


*0  ***  'V  A 

e  ,  a  ^  0. 


The  probability  that  the  sent  signal  appears  /*h  on  the  ordered  list  of  demodulator  outputs  is  given  by 
this  expression  comes  about  because  the  cumulative  probability  distribution  of 


— (r-.'liTh— '^1  *• 


No  +  E, 


\da,  1-  1,2 . M. 


This  is  the  probability  that  a  Rayleigh  random  variable  with  variance  parameter  ( N0  +  £,)/ 2  will  be  less 
than  /  —  1  Rayleigh  random  variables  with  variance  parameter  No/2  but  greater  than  M  -  I  others. 
The  simplicity  of  this  expression  comes  about  because  the  cumulative  probability  distribution  of  a  Ray¬ 
leigh  random  variable  is  given  by 


r- *.-**_,-.-* 


To  evaluate  in  Eq.  (60),  we  make  the  substitutions 


i  +  A  _  I. 
No  b 


It  follows  that 


q,  -  2*(jY^i1)  Jo"  u(l  -  e-'i]“-‘[e-l'2Y-'e-*1du,  /  -  1.2 . M. 


Using  the  binomial  expansion  we  have 


[I  -  e-"1)*-'-  [M  ~  j(-l)"e-"* 

and  Eq.  (62)  becomes 

«  -  2»  f"  I V  |V  -  j  (-1)".-“’*, 
-  ftr,1)  (w„- 1  i ■ 


.-(a+n+i-nu1 


du,  /  —  1.  2 . M. 
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Since 


JQ 


1 


2(«  +  /  +  b  -  1) 


we  may  simplify  Eq.  (64)  to  become 

Kt-l 


*  ”  *  %  I"-'  V-"'  rnr  2 . " 


where 


b  - 


1 


(65) 

(66) 


From  Eq.  (66)  we  are  able  to  express  the  ranking  probability  vector  q  as  a  function  of  EJ N0. 
With  this  it  is  possible  to  determine  the  cutoff  rate  parameter  R0  as  a  function  of  E,/N0.  This  can  be 
done  for  list-of-L  detection  using  the  expression 


Ho 


log2  M  -  2  )og2 


+  -  /(A/-L)  1  -  2> 

/-i  V  /-i 


(67) 


The  plots  of  *o  vs  EJNq  are  given  in  Figs.  19  through  23.  For  convenience  all  of  the  L  —  1  (hard 
decision)  curves  are  collected  in  Fig.  24. 


Fig.  19  —  Rq  vs  EJ Af0  for  Rayleigh 
fading  channels 
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Fig.  24  —  R o  vs  Es/N0  for  Rayleigh 
fading  channels 

In  Figs.  25  through  29  are  plotted  the  minimum  required  Eb/N 0  vs  code  rate  R  (information  bits 
per  channel  bit),  assuming  that  the  encoder  is  operating  at  the  cutoff  rate.  For  this  c<  idition  the  code 
rate  and  Eb/N0  are  given  respectively  by  Eqs.  (54)  and  (55).  Again,  the  L  *  1  curves  are  gathered  in 
Fig.  30.  In  Figs.  25  through  29  we  see  that  it  is  possible  to  operate  in  the  vicinity  of  Eb/S0  =  10  dB 
provided  that  the  code  rate  is  kept  in  the  low-rate  range,  that  is,  approximately  R  =  1/4  or  less.  From 
hard-decision  detection  to  larger  list  sizes,  there  is  a  modest  improvement  (approximately  1  dB)  This 
improvement  mainly  exists  for  small  list  sizes  (L  =  2  and  4),  and  further  improvement  is  negligible  for 
L  >  4.  Thus,  for  Rayleigh  fading  channels,  there  is  some  improvement  in  using  list-of-Z.  detection 
over  hard-decision  detection,  but  large  list  sizes  offer  little  advantage. 


CONCLUSIONS  AND  RECOMMENDATIONS 

This  report  contains  the  results  of  an  introductory  study  on  list-metric  detection.  This  investiga¬ 
tion  was  motiviated  by  the  need  for  more  effective  detection  schemes  to  operate  in  fading  and  jamming 
environments.  With  list-metric  detection,  it  is  possible  to  achieve  a  performance  improvement  over 
hard-decision  detection  while  avoiding  the  difficulties  of  pure  soft-decision  detection  (without  jammer 
state  information)  on  intelligent  interference  channels. 

List-metric  detection  is  a  general  technique  and  includes  list-of-L  detection  as  a  special  case  In 
this  report,  lisl-of-L  detection  results  are  derived  for  MFSK/FH  signaling  on  a  Rayleigh  fading  channel 
jnd  on  an  idealized  worst-case  partial  band  tone-jamming  channel.  Results  show  that  the  improvement 
(over  hard-decision  detection)  for  Rayleigh  fading  is  modest  but  for  the  tone-jamming  channel  the 
advantage  is  considerable. 
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In  a  companion  study  on  list-metric  detection  1 10],  several  aspects  of  the  present  investigation  are 
extended  and  amplified.  These  extensions  include: 

•  Analysis  of  list-metric  detection  on  partial  band  Gaussian  noise  channels  and  partial  band 
tone  jamming  channels  with  multiple  tones  per  subband. 

•  Comparison  of  list-metric  detection  with  and  without  jammer  state  information. 

•  Consideration  of  performance  for  suboptimal  fixed  assignment  list  metrics. 

Refer  to  Ref.  10  for  a  detailed  analysis  of  these  issues.  In  general,  their  conclusions  are  that  list-metric 
detection  is  effective  (compared  to  soft-decision  energy-metric  detection)  when  no  jammer  state  infor¬ 
mation  is  available  and  performs  within  2  dB  of  soft-decision  energy-metric  detection  when  jammer 
state  information  is  available.  Furthermore,  fixed  metrics  can  be  effective  only  over  limited  ranges  of 
signal- to- noise  ratio. 

A  key  issue  concerning  the  use  of  list-metric  detection  is  the  ability  of  the  receiver  to  generate 
optimum  (log-likelihood)  list  metrics.  To  do  this,  the  receiver  must  estimate  (at  least  imperfectly)  the 
probability  of  the  sent  signal  appearing  at  each  position  on  the  ordered  list  of  outputs.  In  general,  this 
can  be  a  formidable  problem  for  fading  or  jamming  channels  but,  if  accomplished,  it  can  lead  to  an 
appreciable  performance  improvement  r  fixed  assignment  metrics. 

Future  studies  in  this  research  area  should  be  concentrated  on  the  problem  of  channel  estimation 
for  the  purpose  of  adaptively  generating  optimal-list  metrics. 
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